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DETAILED ACTION 

1 . This action is responsive to communications: Request for reconsideration filed 
7/30/04. 

2. Claims 1-30 are pending in the application. Claims 1,13, and 22, are independent 
claims. 

3. The rejection of claims 1-30 under 35 U.S.C. 103(a) as being unpatentable over 
Murakami in view of Lieberman has been withdrawn pursuant to the Applicant's 
argument. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-30 are rejected under 35 U.S.C 103(a) as being unpatentable over 
Borovoy et aL, USPN 5,873,107 filed (3/29/96). 

In reference to independent claim 1, Borovoy teaches: 

Information returned to a user based on the analysis of text and could be viewed 
by the author so as to view the full context from which it came (compare to "providing 
metadata associated with the stored images"). See column 3, lines 15-35. Because the 
claim limitations are to be given their broadest reasonable interpretation within the scope 
of the art, the document presentation methods and display icons taught by Borovoy 
provide the suggestion of source or metadata associated with an image. Because audio 
and image based files typically have text based file names or other descriptive 
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information associated with them, they can likewise be searched for and retrieved. One 
can imagine numerous possibilities where an author is writing about a particular subject 
and the retrieved material includes relevant still images, graphics or video clips. See 
column 6, lines 35-45. 

In the preferred embodiment of the present invention, the author enters text in one 
portion of the user interface (compare to "running a user application in which text is 
entered by a user"). See column 3, lines 15-17. 

Keywords are extracted from the text as the author enters the text and are used as 
query words for an information retrieval mechanism to search a collection of documents 
(compare to "continuously monitoring text typed by the user into the application to 
isolate the context expressed by the texf'). See column 3, lines 17-20. 

Those queries return relevant material, which could be images, from the 
document collection in a second portion of the user interface (compare to "matching the 
context with the metadata associated with the stored images, thereby providing one or 
more matched images"). See column 3, lines 21-24. 

The user can then read or ignore the returned information or he can select it so as 
to view the full context from which it came (compare to "retrieving and displaying the 
matched images"). 

The reference does not explicitly disclose utilizing the context to provide 
suggested annotations to the user for the matched images, together with the capability of 
selecting certain of the suggested annotations for subsequent association with the 
matched images; however, the reference provides the variant form of the invention 
utilizing the retrieval of images based on the author's text. The author would input text, 
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which then causes the image retrieval application to begin, followed by the user having 
the ability to manipulate said image. The user would have the decision of what to do with 
that image data, but the invention provides the suggestion of manipulating data retrieved 
by the application. Therefore, it would have been obvious to one of ordinary skill in the 
art at the time the invention was made to have modified the image retrieval methods 
taught by Borovoy and included the feature of annotating the retrieved image, because 
the invention provides a means for manipulating the retrieved data and improving an 
author's formal document research based on past works. 
In reference to dependent claim 2, Borovoy teaches: 

The user can then read or ignore the returned information or he can select it so as 
to view the full context from which it came. See column 3, lines 20-25. 
In reference to dependent claim 3, Borovoy teaches: 

The document collection can merely be those previously authored by the user, in 
the case of the user building on his own previous work, or can be a much larger collection 
as might be available in a database or on a server or even on the internet. See column 3, 
lines 40-47. ^ 
In reference to dependent claim 4, Borovoy teaches: 

Additional relevant material matching keyword has likewise been retrieved as can 
be seen in figure 2. See Borovoy, figure 2. 
In reference to dependent claim 5, Borovoy teaches: 

The user interface in the preferred embodiment also displays the title of each 
return and can easily be extended to include other document or keyword related 



Application/Control Number: 09/685,1 12 Page 5 

Art Unit: 2178 

information such as creation data, creator, document/file type, relevance ranking, etc. See 
column 4, lines 1-15. 

In reference to dependent claim 6, Borovoy teaches: 

The user interface in the preferred embodiment also displays the title of each 
return and can easily be extended to include other document or keyword related 
information such as creation data, creator, document/file type, relevance ranking, etc. See 
column 4, lines 1-15. 

In reference to dependent claim 7, Borovoy teaches: 

The author enters text in one portion of the user interface. Keywords are extracted 
from the text as the author enters the text and are used as query words for an information 
retrieval mechanism. See column 3, lines 15-26. 
In reference to dependent claim 8, Borovoy teaches: 

As the user continues to type in the text authoring area, returns displayed on the 
basis of one keyword are ultimately replaced by those returned on the bases of another 
keyword. See column 4, lines 22-28. 
In reference to dependent claim 9, Borovoy teaches: 

The user interface in the preferred embodiment also displays the title of each 
return and can easily be extended to include other document or keyword related 
information such as creation data, creator, document/file type, relevance ranking, etc. See 
column 4, lines 1-15. 

In reference to dependent claim 10-12, Borovoy teaches: 

The user interface in the preferred embodiment also displays the title of each 
return and can easily be extended to include other document or keyword related 
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information such as creation data, creator, document/file type, relevance ranking, etc. See 
column 4, lines 1-15. 

In reference to independent claim 13, the limitations reflect the instructions used for 
performing similar methods as those claimed in independent claim 1, and in further view 
of the following, is rejected along the same rationale. Furthermore, the reference teaches 
that the document being authored may be as extensive and formal as a daily journal entry 
or e-mail message (compare to "running an e-mail application in which text is entered 
by a user into a message window"). See column 6, lines 25-28. 

In reference to dependent claims 14-21, the claims recite similar instructions used for 
performing the methods as claimed in numbers 1-13, respectively, and in further view of 
the following, is rejected along the same rationale. 

In reference to claims 22-30, the limitations reflect the system comprising instructions 
used for performing the methods as claimed in 1-13, and in further view of the following, 
are rejected along the same rationale. 



Response to Arguments 



6. 



Applicant's arguments with respect to claims 1-30 have been considered but are 



moot in view of the new ground(s) of rejection. 



Conclusion 



7. 



The prior art made of record and not relied upon is considered pertinent to 



applicant's disclosure. 



Wolfe 



USPN 5,870,770 



filed (1/28/1998) 



Hoffert et al., 



USPN 6,374,260 



filed (2/28/2000) 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Matthew J. Ludwig whose telephone number is 571-272- 
4127. The examiner can normally be reached on 8:00am-5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong can be reached on 571-272-4124. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 
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